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Abstract. The formation of network structure is mainly influenced by an individual node’s activity and 
its memory, where activity can usually be interpreted as the individual inherent property and memory can 
be represented by the interaction strength between nodes. In our study, we define the activity through the 
appearance pattern in the time-aggregated network representation, and quantify the memory through the 
contact pattern of empirical temporal networks. To address the role of activity and memory in epidemics on 
time-varying networks, we propose temporal-pattern coarsening of activity-driven growing networks with 
memory. In particular, we focus on the relation between time-scale coarsening and spreading dynamics in 
the context of dynamic scaling and finite-size scaling. Finally, we discuss the universality issue of spreading 
dynamics on time-varying networks for various memory-causality tests. 

PACS. 89.75.He Networks and genealogical trees - 87.23.Ge Dynamics of social systems - 82.20.Wt 
Computational modeling; simulation - 05.45.Tp Time series analysis 


1 Introduction 

Network analysis becomes essential nowadays to figure out 
the dynamical and structural properties of interacting sys¬ 
tems, such as physical, biological, social, and economic 
systems. Most network studies have been done in static 
representations, where network structures are almost fixed 
for the simplicity. However, in general, interactions among 
individuals in the system are time-varying and links are 
also of short duration [1]. As a result, the system forms a 
so-called “temporal network” [5] , where structural changes 
of the system in time cannot be ignored anymore. For the 
case of temporal networks unlike the case of static 

ones, it is very important to consider both structural prop¬ 
erties and time-ordered records of events. Therefore, in 
dynamical systems, understanding the network structure 
formation in time becomes crucial. 

Along with the development of technologies, it has 
been possible to obtain time-stamped data isiiziiiiiiiini 
m- Lots of efforts to understand dynamical systems have 
been tried with various methods, from empirical data anal¬ 
yses to analytical approaches [suniiiiiiiisiiiniiii], which 
indicate that the time-ordered information of links and 
resulting network topologies do alter the properties of 
spreading phenomena in epidemics. Previous studies were 
mostly based on connectivity-driven models that properly 
describe structural features with very slow changes, but 
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are not appropriate for short-time scale properties. To 
overcome such limitations, various time-scale tests have 
been discussed in with ambiguous defini¬ 

tions. Moreover, time-window graphs have also been stud¬ 
ied to answer the question of finding the optimal time- 
window size of the system, of which more detailed dis¬ 
cussions can be found in [20] and the most recent review 
paper [5] (see references therein for the Sect. 3.2.3 also). 
On the other hand, a new model called activity-driven 
model were suggested [53] that can generate the instan¬ 
taneous time description of the networks. While Marko¬ 
vian activity-driven models for human activity patterns 
can easily explain the process of structural features in 
time-varying networks, they cannot capture the existence 
of memory (either non-Markovian or history-dependent 
time-causality), which plays an crucial role in emerging 
dynamical heterogeneities [T3ll24ll2^[26ll27l[2^ . For a bet¬ 
ter discussion on the origin of such anomalous behaviors 
due to the memory effect, several attempts have been per¬ 
formed, where memory is considered as exploration |26j . 
preferential return [53] , social reinforcement [ 30 ] j and triadic- 
close mechanism [ 31 ], respectively. 

In this paper, we propose a modified activity-driven 
model with the memory effect on temporal networks, which 
can be understood as a simple variant of previous models. 
Using the time-aggregated networks of five real datasets [551 
[33ll34] . we estimate the range of network parameters to 
provide the proper definitions of activity and memory in 
our model. After tuning the parameters, we investigate the 
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Temporal network Time-aggregated network 

(Short-time scale) (Long-time scale) 

Fig. 1. (Color online) Temporal networks are schematically 
illustrated, where is the window size of observable time, and 
T is the maximum time. Here we use the empirical dataset 
of School (2012) |32| as network realizations. Note that the 
difference in colors and symbol sizes represents the difference 
in nodes’ degrees and strengths. 


role of activity and memory in epidemics |35| (by the con¬ 
ventional susceptible-infected model, SI), temporal-pattern 
coarsening in time-varying networks (by a random greedy 
walker, similar to the most recent study [35]), and ag¬ 
ing tests in coarsening schemes, where we employ the 
extended finite-size scaling (FSS) technique against the 
time-window size (1 < tu, < T) as illustrated in Figured] 
Finally, we conclude the paper with the summary of main 
results and some remarks as well as open questions for 
future studies. 






Fig. 2. At tw = T, the complementary cumulative strength 
distribution, C(s), is measured for five datasets, respectively: 

(a) School (2011, 2012) and Hospital cases decay exponentially 
with slightly different (almost homogeneous) strengths, while 

(b) Brazil and Email cases decay as power-law with heteroge¬ 
neous strengths. In the insets of (b), the strength distribution, 
P{s), is shown as well. 


2 Model 

As key features in human social behaviors, e.g., epidemic 
spreading [3711331133] . we consider both activity and mem¬ 
ory of individuals. While the former can be interpreted as 
the personal inherent ability, the latter can be understood 
as the personal information for the internal record of previ¬ 
ous contacts as time elapses. Hence memory can be treated 
as a physical quantity that is acquired through social envi¬ 
ronment, which is first encoded, kept stored with infinite 
capacity, and retrieved in future dynamics. Particularly, 
in our model, memory is used as the time-accumulated 
personal (long-term) experience, i.e., the non-Markovian 
strength with the individual history and preference per 
node. Based on the similar concept, previous studies have 
used a variety of definitions: activity potential [23] . rein¬ 
forced process [35], the interplay of exploration and pref¬ 
erential return m, and triadic-closure mechanism m- 
Based on the network analysis of five different empiri¬ 
cal datasets: School (2011, ’12), Hospital [33], Brazil [53], 
and Email [31], in the context of time-aggregated net¬ 
works, we propose a modified activity-driven model with 
the memory effect. Particularly, we tune model parameters 
to understand the temporal patterns of empirical datasets. 


2.1 Activity and memory in empirical data 


We define the activity rate at a node i as Oi (the num¬ 
ber of appearance per time), which is directly related to 
the strength, Si = maiT in static networks. Here 

£i{T) is the number of connections from other active nodes 
until the maximum time t = T, and m is the number of 
links generated from an active node. It is noted that the 
strength distribution in temporal networks, can be ob¬ 
tained from the time-aggregated representation dX t = t^. 

Figure [3] shows how the strength distribution behaves, 
P(s) ^ s~^ exp(—s/c), and its complementary cumulative 
function, C{s), decays for five empirical datasets. Note 
that the functional shape indicates the heterogeneity of 
nodes’ activities. Such results can be categorized into the 
two classes of the activity distribution P{a) as follows: 


P{a) ^ a '’'exp(—a/c) 


exp(—a/c) (exponential), 
a~'^ (power-law). 


. ( 1 ) 

where 7 is the activity exponent with 7 > 0, and c is the 
characteristic size of activity when 7 = 0 . 

In contrast, the memory effect can be described as the 
contact pattern and preference between nodes in time- 
varying networks. As shown in Figure jS] we observe that 
the tendency to create new links are not random when the 
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Fig. 3. For five datasets (see Tab.[T]) that are considered as time-aggregated networks: (a) the average degree, (fc(n)), is plotted 
against the personal contact-time step, n, which scales as (fe(n)) ~ n“ with 0 < a < 1.; (b) the normalized rank frequency, 
(fn{r)), is plotted against the rank of the link-weight list ({wn}), r = rank[u)„], for various n = 200, 400, ...,3200; (c) For a 
better understanding of n, the comparison of n with real time t are illustrated. In the static representation, ni,max = Si. 



A A A A A 


Fig. 4. The histograms of the memory coefficient A are measured in five empirical datasets: (a) School (2011) (b) School (2012) 
(c) Hospital (d) Brazil (e) Email, respectively, where the average value of A is shown inside each plot. 


Table 1. All the detailed information for five datasets are 
summarized, where N is the total number of nodes, T is 
the maximum time (the total number of interaction steps), 
7 is the strength/activity exponent, c is the characteristic 
strength/activity, A is the average memory coefficient, and 
is the memory exponent. 


Dataset 

N 

T (step) 

7 

c 

A 


School (2011) 

126 

28 561 

0 

400 

0.6 

0.50 

School (2012) 

180 

45 047 

0 

500 

0.5 

0.50 

Hospital 

75 

32 424 

0 

1000 

0.5 

0.50 

Brazil 

16 730 

50 632 

2.5 

oo 

1.0 

0.12 

Email 

57 182 

447 543 

2.0 

OO 

0.5 

0.20 


memory exists, where we measure two following quantities 
with personal contact-time step, n (not real time t), see 
the difference between t and n in Figure [St: (i) the average 
degree as a function of n, {k{n)), and (ii) the normalized 
rank frequency, (/»(?■)), against the rank of weighted links 
({ui„}), r = rank[r(;„]. When each node can memorize its 
past, we find that the tendency to contact previously con¬ 
nected nodes with the different link preference, as n in¬ 
creases, which is similar to the scaling patterns of visited 
locations in human mobility m- 

In Figure [3^, we observe that {k{n)) scales as 


{k{n)) 


Yl^=i hS{n^ - n) 

EL<5K-n) 


( 2 ) 


where ki is the cumulative degree of a node i up to the 
contact-time step Ui, S{x) is the Dirac delta function, and 
N is the total number of nodes in a time-aggregated net¬ 
work at tyj = T. 

As a result, the probability to contact a new one is 
described as follows: 


Pnewin) = ^ = An (3) 

an 

where j3 is the memory exponent with 0 < /3 < 1, and 
A is the memory coefficient. In other words, nodes inter¬ 
act with previously connected nodes with the probability, 
Poidin) = l—Pnewin), End the memory effect gets stronger 
as /3 —>■ 1. Here we set the memory coefficient A to the av¬ 
erage value of memory coefficient {A ), which is taken from 
the histograms of A in five empirical datasets (see Fig.0]). 

In Figure [Sb, we find that the different preference ex¬ 
ists in the choice of ever connected neighbors per node, 
where we measure the normalized rank frequency of weight 
links, {fn{r)): 




T.f=iMr)0{ni-n + l) ^ 

J2^=i0{ni-n + l) 


(4) 


where fi{r) = YdjA\{wii}]/ni at a node i, and 9{x) is 
a Heaviside step function. It implies that nodes have a 
propensity to interact with the nodes that are frequently 
connected before. 
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(b) [0, T/4] 







Fig. 5. Network properties for two datasets, are compared to those for the model networks at tu, = T/4 and = T, respectively: 
(a) School (2012) vs. the model with {N = 100, T = 25 000 (step), 7 = 0, c = 1/500, A = 0.5, /3 = 0.50}. (b) Brazil vs. the 
model with {N = 15 000, T = 50 000 (step), 7 = 2.5, c = 00 , A = 1.0, /3 = 0.12}. 


2.2 Model network formation 

Based on the results obtained from five empirical datasets 
in the time-aggregated representation, we propose a sim¬ 
ple network model of N nodes, which is designed to cap¬ 
ture the emergence of heterogeneous network properties 
with the memory effect as follows: 

1. First, consider N disconnected nodes. 

2. At each discrete time increment At, each node can be 
active with the probability pi = Qi/ max^]^{ai}. Once 
a node i becomes active, it can generate m links. 

3. Each active node i follows: 

— Case 1 - If the activation is for the first time, con¬ 
nect the node i to any node at random, except for 
itself. 

— Case 2 - Otherwise, do either (i) or (ii): 

— (i) Create a new link with the probability 

P ._ 

^ new,2 — -^""i 5 

and connect it to a new node at random. 

— (ii) With Poid.i = 1 — Pnew.i, coimect the node 
i to one of ever connected nodes with the prob¬ 
ability 

Wij(ni) 




E/ii wa{ni) 


4. At the next time step t + At, update the memory for 
every node, and delete all the edges in the network at 
t. 

5. Repeat the above procedure until t = T. 

Here all the parameters in the model are based on five 
datasets (see Tab. [1]), and we set m = 1 for short-time 
scale interactions without loss of generality. 


2.3 Network analysis: Model vs. real data 

For a better understanding of two selected datasets. School 
(2012) and Brazil, we perform numerical simulations in 
terms of two model settings based on Table [T] 

In Figures[S^ and 5b, network properties for the model 
are compared with those for the corresponding dataset at 
tw = T/4 and t^, = T, respectively: (a) School (2012) and 
(b) Brazil. Although all the other correlations are ignored, 
they exhibit pretty similar behaviors. Models reproduce 
quite well not only in the strength distribution and the 
average degree of the time-dependent strength, but also in 
the degree distribution and the link-weight distribution. It 
implies that the model mechanism enables us to explain 
the procedure of interactions in temporal networks. 
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Fig. 6. For Brazilian dataset-like time- 
aggregated networks of V = 15 000 and 
T = 200 000 (step), we investigate the rel¬ 
evance of activity and memory in epidemic 
spreading, where we measure the infected 
density (p) as time step (ts) increases in 
the SI: (a) P = 0.12 for various activity- 
exponent values, 7 = 2.0, ...,3.0 and (b) 
7 = 2.5 for various memory-exponent val¬ 
ues, P = 0.0,..., 1.0. 





Fig. 7 . The role of activity in the SI at the three values of the memory exponent: P = 0 (a), 0.5 (6) and 1.0 (c), where other 
network settings are exactly the same as those in Figure [G] It is found that the memory effect seems to be stronger in the 
networks with highly active nodes, so that the order of saturation patterns is changed. 


3 Numerical Results 

In this section, we investigate the role of activity and 
memory in epidemics for time-aggregated networks, the 
temporal-pattern coarsening effect on the diffusion by a 
random greedy walker in time-varying networks, and the 
aging effect on temporal coarsening schemes, where we 
employ the extended finite-size scaling (FSS) technique in 
terms of two time scales: One is the aging time (when the 
observation starts) ta, and the other is the time-window 
size tu,, and JV. In particular, we measure the time evo¬ 
lution of physical quantities in terms of the time step: tg 
(the sequence index of the link addition for all nodes) for 
Figures [BJU the real time t [arbitrary unit] (a.u.) for Fig¬ 
ures [5] and iini 


3.1 Role of activity and memory in epidemic spreading 

We revisit the conventional susceptible-infected model (SI) 
to investigate how activity and memory affect epidemic 
spreading processes. Due to the fact that the SI is the 
simplest model of epidemics, lots of network studies have 
discussed about the epidemic spreading behavior using the 
SI and its variants (see the most recent review of epi¬ 
demic spreading on complex networks [35]). Hence it is 
good to be used for the first test of epidemic spreading in 
our model. 

In particular, we focus on how the activity plays a 
role in the time evolution of the infection density, p(ts) = 
I{ts)/N, compared to how the memory effect does, where 
we set at the infection probability A = 1. In the SI with 


A = I, a health node gets infected once it has at least one 
infected node among its neighors on model networks that 
are controlled by the activity exponent 7 from P{a) ^ a~'^ 
and the memory exponent (3 from Pnewin) = An~^. For 
homogeneous activities, it is found that even the strongest 
memory effect (/3 = 1) does not alter the behaviors much, 
so we here only consider both in power-law cases. 

In Figures [ 6 ] and III we observe how p{ts) = I{ts)/N 
approaches one as tg (time step) elapses. In particular, we 
investigate the role of activity and memory in epidemic 
spreading, respectively, for various 7 at a fixed /3 = 0.12 
and for various /3 at a fixed 7 = 2.5. The speed of spread¬ 
ing increases as 7 —>■ 2 or /3 ^ 0 (see Fig. jH]). These re¬ 
sults indicate that the networks composed of highly ac¬ 
tive or weak memory nodes have the higher probability 
of contacting healthy nodes, so that they have the faster 
speed of spreading. Such optimized spreading phenomena 
are observed in Figure jT] where various memory settings 
are tested with the same activity distribution. The ex¬ 
tended FSS analysis of the SI is still ongoing as a separated 
project with the generalized version. 


3.2 Temporal coarsening tests on dynamics 

The difference between temporal and static networks is 
speculated to understand the origin of the optimized spread¬ 
ing against the power-law types of activities and memo¬ 
ries, where we consider a random greedy walker, and let 
the random walker diffuse on model networks as tg for the 
size of time window, tw, varies. Through the history of vis¬ 
iting nodes for the single walker, we measure the average 
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Fig. 8. In time-aggregated networks at the size of time win¬ 
dow, tu,, the average number of distinct nodes visited by a ran¬ 
dom walker, (Vd{ts)), by a single greedy random walker, can 
reveal the network formation procedure as well as the steady- 
state topology as ta elapses, starting at the aging time ta = 0 . 


number of distinct nodes visited by the walker, {Vd{ts)). It 
provides the following extended FSS form as tg varies for 
various because temporal coarsening effectively changes 
the network size at ty, as Ny,{N,ty,)-. 

where /(x) ^ x for x > 1 ; x*” with C < 1 for x < 1 . 

As shown in FigurelH data of {Vd{ts))/tw collapse quite 
well, as a function of x = tsjtyy, where we use the Brazilian 
model network with the setting of 7 = 2.5 and f3 = 0.12 
(exactly the same as Fig.jSJ. Linear scaling behaviors here 
would be rather trivial if there is either memoryless or 
multiple links, while for tg < ty,, {Vd{ts))/ty, ^ 
with with 1/3 < C ^ 1/2- For the latter, the detailed 
discussion is necessary as a future work. In the stage of 
writing our manuscript and in process of submission, we 
find that the similar work was posted by Saramaki and 
Holme |36j , where greedy walks in temporal networks are 
discussed as a tool for exploring and probing temporal- 
topological structures without the detailed discussion of 
scaling behaviors. As a future study, it would be quite 
interesting if scaling properties are carefully discussed in 
the same context. 


3.3 Aging tests in temporal coarsening 






Fig. 9. Scaling collapse of Py,(k)t^^, versus the rescaled de¬ 
gree, fc/tU, for various t™: (a) rj = 0.5 in the regime that 
the average number of nodes, {Ny,{N,ty,))a, increases, at the 
aging time ta = 0, 500, 2000 (a.u.) for various ty, < tsat, 
while (b) 7 = 1 in the regime that (Ny,{N,tyj))a gets satu¬ 
rated at ta = 0, 500, 2000 (a.u.) for large tw > tsat. Here 
tsat — 10® 2^° for A = 15 000 and the time scale is taken 

with real time (a.u.), T = 8496 (a.u.) or 200 000 (step). The 
slopes of guided lines are 2.0, -4.0 and -2.0 (from left to right), 
respectively. 


to scaling behaviors, ty, is found to be relevant to those. 
It is because the total number of nodes, N, is constant, 
and the effective number of active nodes at tyj, Nyj(N, ty,), 
is almost linear to tyj. As tyj gets wider enough to cover 
the total number of nodes, N, irrespective of ty, Pw{k) 
becomes changed from power-law decay to bell-shaped: 


In addition, we study the detailed structures of model 
networks as the aging time ty and the observation time- 
window size ty, vary using aging/history effects. Most re¬ 
cently, burstiness and aging have been discussed in tem¬ 
poral networks [55], which presented how to check the 
presence of aging effects and bursting behaviors. Aging 
effects are performed on model networks for the dataset 
of Brazil. As expected, neither aging effects nor bursting 
are observed. However, we investigate the extended FSS 
properties for tyj and N (see Figs. 1^ and ITOl). 

Figure 0 exhibits how the degree distribution Py,{k) 
decays as k at ty, for various ty. While ty is irrelevant 


Pyj{k)=t-°-^F{k/tl), (6) 

where F{x) ~ x~'^^ with 2 < 7 *, < 4 for x > 1; x^ for x < 

1 , and where the most probable degree fcmp with ij = 
0.5 —)• 1. Note that the shape of the degree distribution 
has been briefly reported in the earlier work |31] with and 
without node population growth. 

Figuredniprovides the basic analysis of time-aggregated 
network topologies in terms of the scaling behaviors of the 
average degree for various ty and tyj. In Figure [TUh. it is 
observed again that ty is irrelevant to the scaling behavior 
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(b) 


g 







Fig. 10. Scaling behaviors of the average degree are plotted as a function of t™, ta, and N\ (a) {{k{N,ta))w/t^^ versus ta/tm 
for various and (b) {k{N,tw))a versus t^/N^ with z = 1.5, where {k{N,t^))^ and {Nm{N,tu;))/N scale as the same variable 
X = t^/N^ . Here {O) is the network ensemble average and O is the temporal average for N\ = 1500 and N2 = 10Vi. 


of {k{N,ta))w but it depends on as follows: 

N 

{k{N, ta))^ = h{ta)/Na{N, ( 7 ) 

i^l 

where Na[N, to) = Yl!i=i d[ki{ta) - 1] and 6{x) = 1 only if 
a; > 0 (0 if a; < 0). Moreover, we find that g{x) = for 

a; <C 1; constant for a; ^ 1; for a: » 1. In Figure [TUb. 
we also investigate the temporal average of {Nw{N,tw))a 
and {k{N,tjj^))a, which are defined as 

T-t„ 

{0{N,t^)) = Y, t^))r/{.T - U - ta). (8) 

T—ta 

The results from Figure [TUI tell us that the average degree 
linearly scales as a: = t^/N^ with z = 1.5(> 1) for x 
10 “^, while the average fraction of active nodes linearly 
scales as a: for a; <C 10“^. 


4 Summary and remarks 

We have analyzed both the interaction pattern in the 
time-aggregated network representation, and the contact 
pattern of empirical temporal networks. In particular, we 
proposed the simplest model of network formation pro¬ 
cedures for time-varying networks with memory, which is 
the best combination of the existing models with activ¬ 
ity and memory in some better aspects. The generation 
of model networks enables us to express the nature of in¬ 
teraction for short-time scales, unlike connectivity-driven 
models which capture mostly static network structures. 

In our model, both activity and memory are denoted 
by the individual characteristics without the other corre¬ 
lations, e.g., the bursting behavior and the variation of 
link densities with time. Nevertheless, the model network 
is well-suited for capturing the scaling behaviors of cumu¬ 
lative distributions, the process of the interaction. Such 


a simple mechanism may be useful to take a quantita¬ 
tive approach, e.g., scaling relations among the exponents 
and critical behaviors at the epidemic threshold of epi¬ 
demic models. Moreover, we observed how activity and 
memory play a role in time-varying networks for various 
model setting parameters, where we quantified such ef¬ 
fects, tested on spreading dynamics by the SI. For a bet¬ 
ter understanding of the difference between temporal and 
static networks, we consider the temporal coarsening by 
using various time-window {t^) sizes, we tested the dif¬ 
fusion by a random greedy walker and the aging effect 
caused by the existence of burstiness. 

Finally, the temporal-coarsening pattern analysis as 
well as the optimal size of observation-time window (tj„) 
should be carefully discussed as a separated topic (similar 
to Ref. [UU] ) in elsewhere since there are lots of important 
issues and open problems to be speculated in the context 
of the universality class and the validity for the extended 
FSS properties. 
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